Hyper-optimized tensor network contraction

نویسندگان

چکیده

Tensor networks represent the state-of-the-art in computational methods across many disciplines, including classical simulation of quantum many-body systems and circuits. Several applications current interest give rise to tensor with irregular geometries. Finding best possible contraction path for such is a central problem, an exponential effect on computation time memory footprint. In this work, we implement new randomized protocols that find very high quality paths arbitrary large networks. We test our variety benchmarks, random circuit instances recently implemented Google chips. obtained can be close optimal, often orders or magnitude better than most established approaches. As different underlying geometries suit methods, also introduce hyper-optimization approach, where both method applied its algorithmic parameters are tuned during finding. The increase schemes found has significant practical implications particularly benchmarking Concretely, estimate speed-up over 10,000×compared original expectation Sycamore `supremacy'

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Tensor Contraction&Regression Networks

To date, most convolutional neural network architectures output predictions by flattening 3rd-order activation tensors, and applying fully-connected output layers. This approach has two drawbacks: (i) we lose rich, multi-modal structure during the flattening process and (ii) fully-connected layers require many parameters. We present the first attempt to circumvent these issues by expressing the...

متن کامل

Strassen's Algorithm for Tensor Contraction

Tensor contraction (TC) is an important computational kernel widely used in numerous applications. It is a multi-dimensional generalization of matrix multiplication (GEMM). While Strassen’s algorithm for GEMM is well studied in theory and practice, extending it to accelerate TC has not been previously pursued. Thus, we believe this to be the first paper to demonstrate how one can in practice sp...

متن کامل

Communication Lower Bounds for Tensor Contraction Algorithms

Contractions of nonsymmetric tensors are reducible to matrix multiplication, however, ‘fully symmetric contractions’ in which the tensors are symmetric and the result is symmetrized can be done with fewer operations. The ‘direct evaluation algorithm’ for fully symmetric contractions exploits equivalence between terms in the contraction equation to obtain a lower computation cost than the cost a...

متن کامل

High-Performance Tensor Contraction without Transposition

Tensor computations–in particular tensor contraction (TC)–are important kernels in many scientific computing applications (SCAs). Due to the fundamental similarity of TC to matrix multiplication (MM) and to the availability of optimized implementations such as the BLAS, tensor operations have traditionally been implemented in terms of BLAS operations, incurring both a performance and a storage ...

متن کامل

Audiometric findings with voluntary tensor tympani contraction

BACKGROUND Tensor tympani contraction may have a "signature" audiogram. This study demonstrates audiometric findings during voluntary tensor tympani contraction. METHODS Five volunteers possessing the ability to voluntarily contract their tensor tympani muscles were identified and enrolled. Tensor tympani contraction was confirmed with characteristic tympanometry findings. Study subjects unde...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Quantum

سال: 2021

ISSN: ['2521-327X']

DOI: https://doi.org/10.22331/q-2021-03-15-410